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non-treatment control group. A LOGO course, involving the training of 
a systematic programming strategy ^ was taught to two of the classes « 
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applied. At the end of the school year, the fulfillment of the 
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conditions were fulfilled in both experimental groups; results with 
respect to explicit training for transfer were less positive. A 
series of transfer tests was administered, and data analysis revealed 
that transfer was obtained in both experimental groups. This finding 
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ABSTRACT 



This study aimed at the development of a powerful LOGO learning environment for 
achieving the following conditions for the acquisition and transfer of thinking 
skills: 1) sufficient knowledge of the LOGO primitives and concepts; 2) mastery 
of the thinking skills within the programming context; and 3) explicit training 
for transfer. A systematic experiment was carried out in three sixth grade 
classes according to the pretest-posttest design with control group* A LOGO 
course, involving the training of a systematic programming strategy, was taught 
in two experimental classes. In one of ^hese classes explicit instruction for 
transfer was also applied. The control group was a non-treat. lent group* At the 
end of the school year condition fulfilment was tei^ted. The findings showed 
that the first two transfer conditions were fulfilled in both experimental 
groups; the results with respect to the third condition were less positive* 
Furthermore, a series of transfer tests were administered* Data aaalysis 
revealed that transfer was obtained in both experimental groups* This implies 
that fulfilment of the first two conditions mentioned above is sufficient for 
reali'^ini; transfer . 



Lieven Vi.TschaMel i\y a Research Associate of the National Fund for 
S c i e n t i i i c Res o arch B e 1 ; ; i urn 



Acquiring thinking and probl«m-solving skills is nowadays a primary educational 
objective [1]. Kocent rosearch in the domain ol: cognitive psychology has 
revealed that l(»nrning to solvo problc?my requires the integrated acquisition of 
three categories of abilities [2]: 1. flexible application of a well-organized 
domain-specific knowledge base, involving concepts, rules, principles, 
formulas, and algorithms; 2, heuristic methods, i.e. systematic search 
strategies for problem analysis and transformation; 3. metacognitive skills, 
involving knowledge concerning one's own cognitive functioning on the one hand, 
and the self -monitoring and regulation ot one's own cognitive processes on the 
other. Learning to solve problems ^ilso supposes that the learned knowledge and 
skills can be applied in new problem situations, even in other content domains; 
in other words, it assumes that tran sfer will occur. 

In this respect, it has often been claimed that learning to program offers 
great potential for t.he acquisition and transfer of important heuristics and 
metacognitive skills, A major advocate of this "cognitive effects hypothesis" 
with respect to computer programming is Pnpert. In his book Mindsto rms ; 
children, computers and powerful ideas [3], he argues that LOGO leads to the 
development in children of general thinking and problem-solving skills such as 
planning, problem decomposition, and debugging on the one hand, and to the 
acquisition of powerful concepts having a wide application, such as variable 
and recursion on the other. Another key idea of Papert's theory is that LOGO 
should be acquired according to a self --aiscovery strategy, analogous to how a 
young child learns to speak. 

Feurzeig, Horowitz and Nicktjrson [A] have given a more systematic overview 
of the cognitive? skills that, childrcm could acquire while? learning to program. 
The most important ones mentioned by these authors are: 

1. rigorous thinkinj^, and the ability to express one's thoughts accurately and 
precisely ; 

2. understanding and hiding able to apjjly important general c:()nccipts such as 
procedure , variable , funct ion , r(K:ursion ; 

3. mastery of h<»uristic methods sucii as plannirij*,, (ltH.:ompos in;', a probl(in into 
its coustitU(Mit part s anci thinking', ol an analop^ous problem; 

A. the ability to d.isc:ov(M and dclnip^ errcns in a solution proctniure, 

5. awareness that tor most, i)roblems there are ditlertnit solution s t rat.e^',it^s , 



One will notice that this list contains aspects belonging to each of the threa 
previously mentioned categories of skills that a competent problem solver 
masters • 

However, an important question is whetheu there is empiric:al evidence 
supporting the cognitive effects hypothesis • A review of the literature shows 
that this hypothesis is mostly justified on the basis oi a rational analysis of 
programminf;, , according to which this complex activity requires a number of 
skills that are considered to be of importance in learning, thinking and 
problem solving in generals Nickerson [5, p. 42] writes in this respect: 
"Perhaps the basic reason for the belief that programming might bo an effective 
vehicle for the acquisition of generally useful cognitive skills is the 
assumption that programming is prototypical vt many cognitively demanding 
tasks ♦ It is a creative endeavor requiring planning, precision in the use of 
language, the generation and testing of hypotheses, the ability to identify 
action sequences that will realize specified objectives, careful attention to 
detail and a variety of other skills that seem to reflect what thinking is all 
about"* Although such considerations are quite interesting, they do not offer a 
sufficient basis for accepting this hypothesis. 

Convincing scientific evidence is needed, the more so since studies in 
other domains showed that transfer is difficult to achieve (e,g, [6, 7]), and 
the results of a number of pioneering investigations with respect to 
programming carried out over the first part of the past decadu also did not 
support this cognitive effects hypothesis. However, the latter sobering 
outcomes can be attributef^ to the; following two a^3pec:t« of these 
investigations. First, the pupils did not acquire sufficient programming 
ability, due to t.he short duration of the hands-on experience (on the average 
about 25 to 30 hours) on the one hand, and to the absence of syst:ematic 
instruction on the other. Second, an explicit and systLMnatic orientation 
towards transfer was lacking (for a review, see [8, 9]). 

Since 198!) we liavo been en{»aged in a research proj(K:t "Computers and 
Thinking'," that relat:(?s to the cognitive eil:et:t:s Ic^arninp, to proj^^ram n LOGO. 
The major objective^ was the development, i:ni)lenunU.ation and (^va luat.ion of a 
powerlu] J.earnin)', (M1\ ironmont aimiaj'^ at th(? acquisition and transl cM' ol )»(Mieral 
thinking skills. focused on a :;ubs(?t c^f the ])robl ein- so] vin^', !;kilJ.s that are 
expected to be influenced by prograiiuninj?^ experience: two mtitacoi'.ni ti ve skills 



(planning and debugging), and two heuristics (problem decoipposition and 
construction of an external problem representation). 

Taking into account the results of earlier work about the cognitive 
effects hypothesis on the one hand, and th^i recent cognitive psychological 
literature on the other, we hypothesized that fulfilment of the following three 
conditions is crucial in order to attain transfer of cognitive skills: 
!• the pupils have acquired sufficient domain-specific knowledge (i.e. LOGO 
language features and concepts); 

2, they have achieved mastery of the heuristics and me tacognitive skill i:? within 
the LOGO environment; 

3, they have learned how to apply the skills taught in the programming 
environment in at least one other content domain. 

As argued before, ])revious research has convincingly shown that lulfilment of 
the first condition alone is not sufficient in order to obtain transfer of 
thinking skills. Therefore, the focus of the present study was the necessity of 
the transfer, conditions 2 and 3. The general hypothesis was formulated as 
follows; "If the first two conditions are fulfilled, transfer of thinking 
skills will occur; fulfilment of the third condition will enhance the transfer 
effect" . 

The project was carried out in two stages. During the school year 1986-87 

an exploratory study was undertaken, aiming at the development, tryout and 

revision of a LOGO teaching-learniag environment, and at the construction of 
instruments for measuring pupi].s' knowledge and skills within the LOGO 
environment (transfer conditions 1 and 2) (see [10] for more detailed 
information)* To test the hypothesis mentioned above, a more s ystematic 
teaching experiment was undertaken during the school year 1987-88. In that 
experimer t the teachinp,-learning environment was extended with oru crucial 
component, namely i.ho explicit training for transfer (transfer condition 3), 
The present article deals with the design and the results of this second study, 

MKTHOD 

Sul)]ects- 

The subjec:tf; were ]2 year-old children, who had no prior f?xporienc:e with 
compute.' in ^^^tnieral. and with LOGO in ])articilar. All participants were* drawn 



from three sixth-grade classes, with 2A pupiis each (n««72). Two classes served 
as 'Experimental groups (El and li2), while the third one v/as a control group 
(C), In the beginning of the school year an intelligence t:ost and a school 
achievement test were administered in all three classes; no significant 
differences between the three groups were found. 

Design 

The experiment was carried out according to the pretest -posttest design 
with control group. In El, the fulfilment of the first two transfer conditions 
mentioned above was pursued through a 6()-hoiir LOGO course, involving the 
systematic instruction of the primitives of the LOGO language on the one hand, 
and of a strategy to wri t:e programs using LOGO • s graphical mode on the of her . 
This strategy involves two main phases, namely a planning phase and an 
executing-and-testing phai:e. It constitutes the operationalisation of the 
previously mentioned general thinking skills that we aimed at in the LOGO 
course: planning, debugging, decomposition, and external representation. In E2, 
all three transfer conditions were pursued: on top of the LO^O course, the 
children were taught how to apply the learned skills in another context, namely 
in solving multi-step nuithema tical word problems. The control class was a 
non- treatment group. 

LOGO learning environment 

A LOGO course oullined in Table 1 was l.augiiL in rm» two I'xperimental 
groups one aft(?rnc)on each week during the whole school year (approximately 60 
hoors ) . 



Insert Table 1 here 



The teaching was taken car e ot by iiUMnbtM;s of. tiui res(?ar;c:h t cviiii, in cooiMM-a t ion 
with the tieachcr. The comput.cr room, which was dir oct/I y acc(M; i lil l:c)nn the 
regular classroom, was equipped with nine Phili.jjs MSX-^i)icrof:oni[)Ut '^rs . The 
course corif.rsted of t:wo major components, namely the t(?ac:hin)» of: I: tie LOGO 
primitives and concepts (transj:or coii«Ution 1) on t!ie am) hand, and the 
trainin;^, ol' the iJ:opj;aiiiiin ni^ strat(?(»y (transi'er coiuliton 2) on tlu' c.I.Ihm . 



Teaching LOGO primitives and concepts (transfer condition 1) - The content 
of the LOGO coxxrse was limited to the so-called turtle graphics. Moreover, the 
children were only tauj-'jht those LOGO primitives and concepts considered 
necessary with a view to the acquisition of the intended programming strategy. 
More specifically, the following notions of LOGO were treated: making simple 
drawings using the basic LOGO primitives (FD/BK, RT/LT, PU/PD), working with 
the REPEAT command, writing procedures and supurprocedures ♦ 

Starting from a moderate constructivist conception [11], we assumed that a 
powerful learning euvironnient is characterized by a good balance between 
discovery learning on the one hand, and systematic instruction on the other. 

A first example of structuring the pupils • learning processes is 
presenting the LOGO primitives and concepts in a well-considered sequence. We 
only passed on to the next primitive or concept if the lesults of an 
intermediary test showed that the former was sufficiently mastered. 

Second, the teaching of a new LOGO primitive or concept was performed in a 
rather systematic way, mostly via demonstration at the computer or in a 
discussion format . During these demonstrations and discussions we made use of 
our knowledge of children's typical errors and misconceptions, that we had 
acquired during the exploratory study. For example, to avoid the typical 
misconceptions and errors with respect to angles [10], we inserted activities 
like playing turtle, indicating the turning angles in a clear and uniform way, 
estimating angles, and measuring angles using a protractor. 

Afterwards, the children were given ample opportunity to practise the 
nev/ly learned primitive or concept mostly in small groups of two to three 
pupils at the computer. To stimulate exploratory activities, challenging tasks 
were provided. We also constructed game-like microworlds , in which the children 
could exercise certain LOGO notions in an intensive but attractive manner. The 
"direction game", for instance, aimed at practising the primitives LT and RT, 
Its goal was to send the turtle, that moved with a certain s])eed and in a 
certain direction over the screen, to its no3t, using LT and RT instructions. 
The practising phase was concluded with a discussion ot children's 
difficulties , f indinj^^s and s t rate;»ies , 

To wind ujj with, the children each time had the occasion to practise the 
newly mastered LOGO knowledge m integration vit.h the previously luarned ones 
in more extensive iL^- yL~J-'^il:^^-^' ])roje(:ts. 



Teaching of a strategy for writing LOGO programs (transfer condition 2) - 
The LOGO programming strategy that was taught, consists of two main phases: a 
planning phase, and an integrated exocuting-and- testing phase. As said before, 
this strategy involved two metacognitive components, namely planning and 
debugging, and two heuristics, namely problem decomposition and construction of 
an external representation. Planning and debugging were instructed respectively 
in the first and the second phase. The? two heuristics were taught in the 
planning phase. 

In the j^la^nnin^ p hase , carried out independently from the computer, three 
steps are distinguished (see Figure 1), 



Insert Figure 1 here 



- Making a drawing of the intended screen effect, 

- Constructing a tree-like diagram in which the complex drawing is subdivided 
in building blocks that are easy to program; this diagram involves at the 
sime time the sequence in v/hich the different parts have to be drawn on the 
screen, 

-Making separate drawings of the different building blocks or parts, 
indicating for each part the lengths and angles ay well as the start and the 
end position c^f the turtle. 
Once the planning is completed, the i n t e g rated e xecutin g -a nd -t es ting pha s e on 
the machine can begin » This activity if^ guided by two principles: 

- Top-down programming, involving that the children are taught to start with 
the most global procedure, callod the "mother procedure", which consists of 
the names of the subsequent parts from the sec:ond level of the tree- like 
diagram, together with the names of the "connecting links" that move the 
turtle from the end position of a previous part to the start position of the 
next building blork"^'; jnibsequent ly each component of this procedure is 
specified until chc lowest lev(^l of the tree^-like diagram is reached. 



In the presiMit study, was agre(?d that the name i or a connecting link 
betw^^en two building blocKs consists of the following, t.hree parts: the 
characters "CL" (froai Connecting Link), followed by a dash and the first 
characters of the former and the following block (c.^^, . connecting link between 
WINDOW and MOTOR: CL-WM) . 



- Immediate testing and debugging of each new procedure after defining it. By 
calling the "mother procedure" , the result appears on the screen and can 
instantly be evaJuated; furthermore the error message ("There is no procedure 
named* ♦.") indicates which procedure has to be written next. 

To illustrate these principles, we present the interaction with the 
computer of a child who applies the strategy for drawing the car in Figure I, 
In accordance with the principle of top-down programming, the child first 
defines the mother procedure (CAR) : 
TO CAR 

WINDOW CL-WM MOTOR CL-hfi'f WHEELS'^ 
END 

Then, following the second principle, the child types the name of the mother 
procedure (CAR), resulting in the error message "THERE IS NO PROCEDURE NAMED 
WINDOW AT LEVEL 1 OF CAR", Next the WINDOW procedure is defined: 
TO WINDOW 

REPEAT 2 (FD 15 RT 90 FD 40 RT 90) 

END 

As a result of the subsequent testing (CAR), the following screen effect is 
obtained (see Figure /I): 



Insert Figure 2 here 



The error message at the bottom of the screen indicatfis that the connecting 
link between the window and the motor (CL~WM) is the next procedure to be 
written. The child types: 
TO CL-WM 

PU RT 90 BK 10 PD 

Calling the mother procedure (CAR) results in the following 'jcreen effect (see 
Figure 3 ) : 

^For the sake of clarity, the children wer(? tcun^ht to iJtart a n(^w Jim? lor 
each procedure in a superprocedurc^ . lit:)wever , in thii; text al l {)roceduri}s are on 
one line? because of the limited si)ace available. 



Insert Fij^ure 3 hure 



Subsequently, the child writes the proceciure tor the motor; e.t',. 
TO MOTOR 

COVER CL-CL LIGHTS CL-LR RADIATOR 
END 

VHien afterwards the mother procedure (CAR) is called, the turtle again draws 
the window and the connecting link between the window and the engine, and then 
gives the message "THERE IS NO PROCEDURE NAMED COVER AT LEVEL 1 OF MOTOR". The 
next procedure to be written is the COVER procedure. 

This process is repeated until all building blocks and connecting links of 
the MOTOR procedure, and subsequently all parts cf the remaining components of 
the mother procedure (CAR) are defined. 

The explicit teaching of this programming strategy constituted the major 
component of the LOGO course. We already tried out our learning environment in 
the exploratory study [10]. This lead to the following findings. When asked to 
write a program for a complex drawing at the end of the course, several 
children did not construct a tree diagram spontaneously. The interviews 
revealed that a number of them did not see the benefits of using the strategy 
that was taught. Other pupils expressed their negative feelings towards the 
taut strategy. However, w(i also found l:hat several children, if explicitly 
asked to do so, were unable to construct a correct tree-diagram. Therefore, we 
modified the teaching-learning environment: in the present study the intended 
strategy was taught in a more systematic manner, however without being too 
strict; furthermore we tried to motivate the children to use the strategy. In 
that perspective we applied several teaching strategies that are considered in 
the recent literature to be ettect.ive for the instruction of general thinking 
:^kil Is : modelling, seatf oidin); , c:oaching, fadinj^,, articulation, reflection and 
ex])lora tion [ 1?. ] . 

At first , the euti) t strat.ej'^y wa:3 diMnonstrated !jy an "ex{)ert:" (a meir.ber of 
thi? r esearch team) , with a vi(?w to he] ping t:he children t:o build a conceptual 
model of t.he steps and i)rocesses requir (>d to carry out the task (niodj^ll inj'^^) . 

Them each component oi* the strategy was t.reated and ])ractised separately. 
In this j)hase scaffoldinj^ was uschI, .involviu}; that the ttnichiM^ provid(?s direct 



support to the pupils in carrying out those parts of the task that were beyond 
their unassisted efforts. For ins^'ance^ a computer program was used to help the 
children in constructing a tree-diagram. This program guided the decomposition 
process during the planning phase through a series of simple questions (e.g. Is 
MOTOR simple enough? V> h are the constituting parts of MOTORV ) . Through the 
repeated use of this program for constructing diagrams for a diversity of 
drawings, we pursued the internalization of the planning strategy. 

Nr.xt, the children were given ample opportunity to practice the whole 
strategy, working on progressively more difficult problems in small groups of 
two to three pupils ( exploration ) . In order to help the children perform the 
strategy autonomously, they were provided with several charts containing the 
different steps of the strategy and other useful information. In the beginning 
the pupils were guided intensively ( coaching ) , using hints, explanation and 
feedback. In doing so, we took into consideration the errors, misconceptions 
and difficulties observed in the exploratory stucy. For instance, the criteria 
for a correct tree-diagram and the classif icatior of errors derived fi'dii an 
analysis of the material of the previous exploratory investigation, were made 
explicit to the pupils, and this terminology was used while discussing the 
tree-diagrams that were made in all projects throughout the school year. Later 
on teacher help and supervision decreased with increasinj', student ability 
( fadin g ) . 

Throughout the instruction and practice of the strategy, the children were 
stimulated to spell out the procedures and skills they used (articulation) , and 
to compare them with those of other children and with the exi)ert model 
(ref ] ection) . With a view to attaining transfer, the exj^licit and intentional 
abstraction of the trained thinking skills was pursued. 

To enhance children's motivation to use the progranuning strategy, a 
substantial amount of time was spent demonstrating its use and benefits. For 
instance, pro);rams were written for a siu'j.es of similar, but nut identical 
drawing^s; this rev(?aliMi the beni^fits of modular and planful working methods, 
such as reusability, compartmentalizat , and efficiency. Furthernune , it was 
demonstrated that the actual coding of th(3 program at the computer proc(M.Ml:s far 
mori? easily and efficiently wh(?n one can start from a complete plan. 

Finally, to avoid that the pupils developed an aversi.(ni for a t(n) rigidly 
and tautly imi)C)se(l strategy, w(? allow(?d tbem to follow rhe ;n;ocedur(^ l(?sii 
strictly as the school y(?ar prociMided. This is ptM'f(M;lly in accordarujc with (nir 
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view of the learning procesf?. We consider the full strategy as an appropriate 
initial structure of action, in whvch thu solution procp^s is externalized very 
extensively. However, during the further course of the acquisition process, 
this structure of action can progressively b« abbreviated (by omitting some 
parts) and internalized. 

Explicit instruction for transfer (transfer condition 3) 

In the second experimental group (E2) explicit instruction for transfer 
was provided in an additional mini-course in word-problem solving, in which the 
pupils learned to apply the skills acquired in the LOGO context (namely 
planning, debugging, decomposition, and external representation) in solving 
multi-step arithmetic word problems. More specifically, the children were 
taught a strategy involving two main phases: a planning phase, and an 
executing-and- testing phase. As in LOGO, the planning phase consists :.a 
subdividing the multi-step problem into subproblems that can be solved easily; 
this activity can also be represented in a tree-like diagram (see Figure 4). In 
the integrated executing-and- testing phase, each subproblem is solved and the 
outcome is immediately tested. 



Insert Figure A here 



Mastery tests 

Before assessing the transfer ettert, wo examined fulfilment of the 
transfer conditions mentioned above. In both experimental classes the 
realization of the first two conditions was assessed one month before the end 
of the course, using one or more mastery tests for each condition. For each 
test a mastery crit(-rion for the whole class was put forward: 75Z of the 
children had to obtain 2/3 of the luaxlmujT- score on the test. When this 
criterion was not attained, we considered the relating condition as not 
sufficiently fulfilled. In that case, remedial instruction was provided for 
those children who did not meet the predetermined criterion. Afterwards, 
condition fulfilment was rc^assessed at the end of the school year. The tests 
with resi)ect to word-problem solvini; (third transfer condition) were 



administered only once, because there wac no time available for remedial 
instruction and retesting. 

Mastery of cha LOGO knowledge (tvansfev condition 1) - The test to assess 
the knowledge and understanding of the LOGO primitives and concepts consisted 
of 20 items relating to the following topics: the elementary primitives (FD/BK, 
RT/LT, PIJ/PD), the REPEAT command, and the flow of control in superprocedures • 
The children either had to indicate which of four alternative LOGO conimands or 
procedures would produce a given screen effect, or to select the appropriate 
drawing for a particular LOGO command or program. The choice of the 
alternatives was inspired by the common errors children make. Figure 5 contains 
an example of an item for each of the three topics. 



Insert Figure 5 here 



For each correct answer, one point was given, A correction for guessing was 
applied on the total score using the following formula: T=C-(I/A-1) 
(Total score after correction. Correct answers, jEncorrect answers, and 
Alternatives ) , 

Mastery of the programming strategy (transfer condition 2) - To assess 
mastery of the programming strategy, three tests were administered. Two 
paper-and-pencil tests dealt with the construction of a tree-like diagram (= 
planning stage); the third one was an individual test at the computer, and 
concerned the integrated executing-and-tes ting phase. 

In the first plan ning test each item consisted of a drawing with two 
tree-like diagrams, only one of which wa^; cc^rect. The children were asked to 
irdicate the correct tree diagram for the drawing. Figure 6 sliows an example of 
an item. 



]. n s r t K i \\ u r e 6 he r e 



The errors included in the tree-diagrams were a^'^ain lielected on the? basis ol 
children's solutions on tests administered in the exploratory study [10]. The 
error analysis of these tasks resulted in a classification in severe and slight 
errors; in each category j.ev(?ral t.ypes ol errors are dis tinj?,uishecl . A si?vere 
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error is one that results in a faulty screen effect, e.g, one part of the 
drawing is forgotten in the tree-diagram, A tree-diaRram containing a slight 
error deviates from the expert model, but this does not lead to an erroneous 
screen effect, e.g, two identical parts are givon a different name. Half of the 
20 items in the test contained a severe mistake; the ot:hor half a slight one, A 
correct solution on an item of the first category yielded two points; the other 
ones one point. Hence the maximum score on this test was 30, 

In the second planning test the children had to construct autonomously an 
apprt^priate tree-like diagram for a given drawing (see Figure 7), 



Insert Figure 7 here 



In scoring this test, we started from an expert model of the diagram, Wh^n the 
answer of the pupil corresponded to this diagram, the maximum score, namely 10, 
was attributed. For slight and severe faults, one and two points were 
subtracted respectively , 

The individual test concerning t he integrated cxecuting-and- testing phase 
was administered at the computer. The child was asked to write a LOGO program 
for a relatively complex drawing starting from a given plan (see Figure 8), To 
enable us to analyse children's debugging activities, four errors were 
delibe rately included in this plan. 



Insert Figure 8 hero 



During the test, the teacher sat beside the pupil and intervened every time the 
child deviated from the executing-and -testing strategy as taught in the LOGO 
course. First, the teacher asked a well-chosen question (e,g. Is this the next 
procedure that has to be defined?). When the pupil was incapable to answer this 
question, the teacher responded himself (e,g. No, the error message indicates 
that the "BRIDGK" procedure is the next procedure to be written). Every 
intervention was registered; two points were given when no intervention was 
needed, one point whun {'A\o. t(?acher had to ask a qu(istion, and /.ero points when 
he also had to provide the answ(?r. 

Word- pi oh loin tc\^(: (Lransl'rr rond.itiiyn J) - To assess mastery of the 
st.iateivY tor solving iiml ti- step word probleiiif; (the third transfer condition) in 



E2, analogous tests as for LOGO were used. Two f^sts related to the planning 
iLh§l«- In the fi^rsjL one the children had to indicate the best of two given 
tree-like diagrams for a series of 10 word problems. Again, part of the items 
(namely /O containe'i a severe mistake; the other parL a slight one (namely 6), 
An error classification scheme was developed in analogy with the one used in 
LOGO. For a coi-rect solution of an item containing a severe mistake, two points 
were given; for slight errors one point. 

In the second test the children were asked to construct autonomously 
appropriate tree-like diagrams for five given word problems. In scoring this 
test we started from an expert model of the diagram. Wlien the answer of the 
pupil corresponded to this diagram, the maximiuii score, namely 10, was 
attributed. For severe faults, two points were subtracted, for slight faults 
one point. 

The third test dealt with the integ rated cxecutia^>-and- tes ting phase. The 
task was to solve a number of probler^s starting from given diagrams. Each 
correctly solved element in the diagram yielded one point. 



Transfer tests 



The children of all three classes were given a series of transfer tasks in 
order to evaluate their ability to apply the thinking skills trained in El and 
E2 to other situations. At t^- beginning of the school year, a battery of three 
tests was administered, namt..^ the "mazes" test, the "error detection" test, 
and the "block:;" test. At the end of the course, two tests were added to this 
battery, namely the "weekdays" test and the "boxes" test. 

Mazes test - This test, a computer test lor plannin;.^ behavior, was 
administered individually at the machine. The computer subsequently offered 
three mazes, containing a hungry beatle and three salads (see Figure 9). The 
task consisted in sending the beatle by the shortest road through the maze to 
the three salads. The third item, however, was unsolvable because one of the 
salads wu s un a 1 1 . a in a b 1 e . 



Insert Fi(',ure 9 here 
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This test was developed to measure plannin g skill. A first measure for planning 
ability, "mazes/pll"^\ related to the first two mazes. The ucoro was based on 
the total distance the beatle covered. Planning was roquired to find the best 
sequence. Consequently, the shorter the covered distanco was, the better the 
result. The second planning measure, "mazes/pl2", concerned the third maze- We 
registered at which moment the pupil discovered that this item was unsolvable. 
Pupils who made this discovery before giving the first command obtained two 
points; we assumed that they made a plan beforehand. Children who saw the 
unsolvability only after the beatle had eaten the first two salads, were given 
one point, and those who tried to send the beatle to the last salad, got zero 
points . 

Error detection test - This test, which was inspired b}' the work of McCoy 
Carver [13], contained three stories, each one telling about person A giving 
person B directions. Person B followed the directions perfectly, but the 
obtained result was not as intended because one of the instructions was wrong. 
The task was to find and to fix the bug in the directions, so that the 
anticipated result would be obtained (see Figure 10), 



Insert Figure 10 here 



This test was administered individually. It measures two thiuking skills, 
namely planning and debugging. First, the bug had to be located in the list of 
instructions; a planful search of the bug is based on a preliniinar} comparison 
of the discrepancy between the obtained and th(^ intended effect, Wlien such a 
plan was made before starting to execute the directions one by one, one point 
for piannina skill ("error/pin") was given; a child obtained zero points if 
this phase was skipped. Subsequently, to correct tlu^ bug, the directions had to 
be ex(K:utCKi in order to compare the result with the intended outcome. One point 



Th(^ names of the transfer measures are cdiiipoiMMl ai' two parts: t:he first 
part refers to the concerned transfer test; the sc^cond part, to the thinking 
skill that is being measured (x^lanning, dehugi^i nj^,, problem decomposition , and 
construction of an exj^ernal representation). 
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for debufiRinR ability ("error/deb") was attributed if the bug was appropriately 
corrected, zero points when this was not the case. 

Blocks tost - In this test, one had to describo 10 complex figures in 
terms of their component parts, making use of a series of given simple elements 
or other less complex figures (see Figure 11), To ^oscribe the figures, the 
least possible elements had to be used. 



Insert Figure 11 hero 

Solving this test efficiently requires application of the decomposition 
heuristic. The scores for this skill ("block/dec") ranged from 1 to 10; one 
point was given for each correctly solved item. 

Weekdays test - This test consisted of ten items such as "If tomorrow is 
Saturday, which day is the day before yesterday?" [14], An efficient strategy 
to solve such tasks consists in the use of an external representation . The 
score for this heuristic ( "weekd/ext " ) was one or zero*, one point for a correct 
representation, zero points in all other cases. This test also measures the 
decompositio n skill. In order to obtain the correct solution, it is necessary 
Lo decompose the problem, to solve each part separately and to link up the 
answers to a conclusion [14], The score for "weekd/Hec" was one if the external 
representation contained a decomposition of the problem; ?,ero if this was not 
the case. Figure IZ shows two examples of an external representation and a 
decomposition of the problem mentioned above. 



Insert Figure 12 here 



Boxof^ test - Cliildren's mastery or the u^n? of external representations was 
also tested in the boxes i.ost, consisting of ten items; for example, "There is 
one big box. Inside the big box there are two S{?parate medium boxes. Inside one 
of the medium boxes there are three small boxes. Inside the other one there are 
four boxes. How many boxes are there all together?" [14], One point was given 
if an appropriate graphic representation of the problem was made ( "boxes/ext " ) ; 



otherwise, the child obtained zero points. Figure 13 contains two examples of 
an external ^'opresenta tion for this item. 



Insert Figutf^ 13 h(?r(? 



RESULTS 

Results on the mastery tests 

Table 2 shows the number of pupils in El and E2 that reached the 
predetermined mastery criterion (2/3 of the maximum score) on the different 
tests by the end of the school year. 



Insert Table 2 here 



The results on the LOGO knowledge test indicated th.it by the end of the 
experiment most children in both experimental classes (21 and 17 in El and E2 
respectively) had acquired a sufficient level of knowledge and understanding of 
the LOGO primitives and concepts (first transfer condition). 

The outcomes on the measures relating to the programming strategy (second 
transfer condition) were also very positive. The results on the first planning 
test showed that in El and E2 resp. 19 and 23 children were sufficiently able 
to indicate the correct diagram for a series of drax^ings . The second planning 
test revealed that in El and E2 resp. 20 and 19 pupils succeeded in 
constructing autonomously an appropriate tree-like diagram for a given drawing. 
On the test concerning the executing-and-tes ting stage of the programming 
strategy, namely writing a LOGO program for a relatively complex drawing 
starting from a given plan, most of the children (20 in El and 22 in E2) were 
able to apply the instructed strategy efficiently: they used the top-down 
progranuning style fairly consistent; each time a new procedure was defined, it 
was tested by calling the so-called mother-procedure ; and when an incorrect 
screen effect was obtainod. detection. analysis. and debugging of the 
programming error was performed in a systematic and straightforward way. The 
preceding results juytify the conclusion that the children were able to apply 
the intended general thinking skills within the LOGO L»nvironmeut . In summary, 
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by the end of the LOGO course both the first and the second transfer condition 
were rulfilled. 

Table 2 also shows that the results on the tests with rei^poct to the third 
transfer condition, namely explicit orientation toward transfer to other 
domains, were less positive. In E2, only 10 out of Ik children were able to 
apply autonomously the planning strategy in the domain of arithmetic word 
problems (second planning test). Although their performance on the other two 
tests was quite good, we consider the third condition as not sufficiently 
fulfilled » the argument being that the second planning test was undoubtedly the 
most critical measure of -strategy mastery. Unfortunately, because the school 
year was at its end, there was no time available for remedial instruction. 
Taking into account this latter findinj^, , a conclusive test of the second part 
of our main hypothesis, namely that the fulfilment of the third condition 
enhances transfer, became impossible in uhe present study. 

Results on the transfer tests 

A multivariate analysis of variance (MANOVA) was applied to analyse the 
data for each of the four thinking skills separately. When all transfer 
measures were involved in the pretests as well as in the posttests, a two-way 
MANOVA was performed (groups x tes tsessions ) ; in the other case we applied a 
one-way MANOVA (grouj^s). When the multivariate analysis for a particular skill 
showed a significant effect, an addidional univariate analysis (ANOVA) was 
conducted to specify this result. More S])ecif ically , for each of the transfer 
measures related to this skill we computed the size and the direction of the 
ef f ec t . 

Separate analyses were performed for El and C on the one hand, and El and 
E2 on the other. According to our initial hypothesis. El would make more 
progress from the pretests to the posttests than C; moreover E2 would 
outperform El. 

The multivariate analyses showed that the El j^roup diifered significantly 
from the C group on probl(;m decomposition, coniitruction of an external 
representation, and debugging (see Table 3). The additional univariate analyses 
indicated signifi(^ant effects on each of the transfer m(?asures with respect ot 
the three skills; moreover these effects were in th(^ (ixpected direction: El 
significantly out perlormed C on error/dtib (p-.OOl) . block/dec: (p-.008), 



weekd/dec (p=,005), boxes/ext (p<.001) and weekd/exf. (p=.001). This loads to 
the conclusion that the LOGO treatment was successful in obtaining; transfer for 
three out of tho four thinking skills that wore taught. 



Insert Table 3 here 



The MANOVA on the measures for planning skill (mazes/pll, niazes/pl2, error/pin) 
showed no significant differences between El and C: both groups performed 
equally well on the tests requiring this skill. This is somewhat surprising, 
since the planning component was the core component of the trained strategy. 

As we expected on the basis of the non-fulfilment of the third transfer 
condition, E2 did not make more progress than El. Unexpectedly, we even found 
significant effects in the opposite direction: El outperformed EZ on the 
measures for problem decomposition, construction of an external representation, 
and debugging (see Table 3). 

DISCUSSION 

In the present acticle we described the design and the results of a one-year 
teaching experiment, in which we implemented and evaluated a LOGO teaching 
■> 'arning environment aimed at the acquisition and transfer of general thinking 
skills. The study took place in three sixth grade d.^sses according to the 
pretest-posttest design with control group. 

Three conditions that are important with a view to the attainment of 
transfer were derived from the literature. The first two conditions - 
acquisition of a sufficient level of domain- spec if ic knowledge on the one hand, 
and mastery oi the intended thinking skills within the LOGO context on the 
other - were pursued in a 60-hour LOGO course taught in both El and E2. In E2 
explicit ::raining for transfer (third condition) was alsjo applied in a 
supplementary math course. 

Before assessing the transfer effect, wo . examined fulfilment of the 
tJL^^JLillt^L-l'Mij;!^ The results on the LOGO mastery tests indicated tliat the 
first two conditions were achieved: the pupils had acquiriid a suificient level 
of LOGO knowledge and could successfully apply the thinking skills in the LOGO 
context. In our opinion, these positive results can he attributed to the 
carefully cnnHtructed instructional environment, in wliich the 5 t-comings of 



former studies were overcome. Two important characteristics of this learning 
environment were: 1) its time-intensive character, and 2) the balance between 
exploratory learning activities on the one hand, and systematic instruction 
(e.g. the explicit teaching of a programming strategy) on thu other. However, 
in evaluating these findings appropriately, one should certainly take into 
account that the results were obtained in a rather a-typical situation (60 
hours of LOGO instruction, 9 computers and h experienced teachers for 20 
children), which is not representative of the current 'situation in Belgian 
elementary schools . 

We did not succeed in realizing the third transfer condition. After 
several lessons focussing on the explicit instruction in applying the 
pr.: blem-solving skills taught in the LOGO environment to the domain of 
mathematical word problems, most children in E2 were not sufficiently able to 
do so at the end of the course. This disappointing finding is probably due to 
the existence in children of inefficient strategies, attitudes and beliefs 
about word problem solving, which they had acquired over the years during their 
normal math lessons, and which were difficult, if not impossible to change 
substantially within the available amount of time [15]. 

The transfer results with respect to the first part of the hypothesis, 
namely that fulfilment of the first two transfer conditions is sufficient for 
obtaining transferable thinking skills, are rather encouraging. Generally 
speaking, the LOGO group (El) significantly outperformed the control group on 
the transfer tests for three skills, namely problem decomposition, use of an 
external representation, and debugging. Similar positive transfer results were 
reported in other recent studies (for example [13, 16]; for an overview, see 
[8, 9]). A common factor in these successful investigations, is the explicit 
instruction involving "mindful abstraction" [6, 17] of the intended genfiral 
thinking skills within the LOGO environment. 

The second part of the hypothesis, namely that decontextualisation by 
teaching the skills in other domains (condition 3) would enhance the transfer 
effect, was not confirmed. The ])U])ils who followed the math course (E2) did not 
obtain better transfer results than those from El; we even found that in E2 
less transfer occurred. However, in our opinion it would be premature to 
conclude from these findings that explicit training for transfer has no or even 
a negative influence on the development of general thinking skills. Indeed, the 
abjunice of the expected transfer effects, can explained by the 



non-fulfilment of the third transfer condition. Hence, a conclusive test of the 
importance or the necessity of the third transfer condition became impossible 
in this study. On the other hand it is often suggest in the transfer 
literature that the application of the intended thinking skills in a diversity 
of situations is crucial to bring about abstraction and decontextualisa tion 
(see also [6, 18]). Therefore, we tend to hold on the hypothesis that if one 
succeeds in realizing the explicit instruction for transfer properly, 
additional uransfer effects will occur, 

A plausible explanation for the fact that in E2 less transfer was found, 
relates to motivational factors and classroom atmosphere. Although systematic 
data are lacking, there are several indications that the replacement of the 
LOGO course by the math course in E2 resulted in a decrease in the positive 
attitudes of the children of that class. 

The starting point of the present study was the questioi "Is learning to 
program a vehicle for the development of thinking skills in elementary school 
children?". On the basis of the obtained results and the gathered experience, 
we think we can formulate a moderately positive answer to this question. Yes , 
the findings suggest that learning to program can result in the acquisition and 
transfer of general thinking skills. However , the positive etfects do not 
merely result from the unique characteristics of the LOGO language as such, but 
rather from the qualities of the instructional system that is applied in 
teaching programming. In other words, LOGO in itself is not a vehicle for 
thinking, but it can be a useful device for the acquisition of general thinking 
skills, if it is embedded in a powerful teaching-learning environment, i,e, a 
context that provokes in children the learning processes necessary to reach the 
intended goals. 

Future research should aim at the identification and analysis of the 
critical aspects and dimensions of such powerful environments. In that 
perspective, we refer briefly to some research-based ideas from the domain of 
instructional psychology that should be taken into account. As a frame of 
reference we use Resnick's [19] distinction between three major components in a 
theory of learning from instruction, namely a theory of expertise describing 
skilled performance in a domain, an acquisition theory explaining the processes 
of learning and development necessary to achieve expert performance, and a 
theory of intervention describing appropriate teaching methods and 



instructional strategies for eliciting those processes of learning and 
developmer ^ . 

So .r cognitive psychological research ha{^ mainly focused on the 
development: of a theory of expertis e . resulting in a better understanding of 
the nature of expert problem-solving and thinking processes. This work led 
amoung others to the identification of three aforementioned major categories of 
skills that arc involved in expert problem solving, namely domain-specific 
knowledge, heuristic methods and metacognitive knowledge and skills. 

Although there is by now no well elaborated acquisition theory available, 
recent research has already yielded some important characteristics of learning 
processes that should be taken into account in designing learning environments. 
Major aspects in this respect are: the constructive nature of learning, meaning 
that learners are not passive recipients of information, but that they actively 
construct their knowledge and skills through interaction with the environment, 
and through reorganisation of their own mental structures; the role of prior 
knowledge in general, and of children's informal knowledge and skills in 
particular, as a starting point for the acquisition process; the need to anchor 
learning in real life experience and to provide learning tasks that are 
representative of the multiple situations in which knowledge will have to be 
used later on; the progressive internalization and formalization as a guiding 
principle for acquiring new knowledge and skills; the influence of beliefs and 
of motivation on learning; and the importance of the explicit teaching for 
transfer (for more details, see [20]), 

An interesting contribution to the intervention component of a theory of 
learning from instruction is the recent work of Collins, et al, [12] to which 
we already referred before. Starting from the cognitive apprenticeship view of 
teaching and learning which embeds the acquisition of knowledge and skills in 
the social and functional context of their use, the authors identified four 
dimensions that are relevant in designing learning environments, namely 
content, method, sequence, and sociology. 

With respect to content, an ideal learning environment should focus on the 
acquisition of all categories of skills that experts master. In addition to the 
three categories discussed in the first section ot this paper - domain-spec. f ic 
knowledge, heuristic methods, and metacognitive strategies - Collins et al, 
[12] mention a fourth type of skills that experts api)ly, namely learning 



strategies, I.e. strategies for acquiring any of the three other types of 
content . 

With a view to helping students to acquire and integrate those different 
categories of knowledge and skills the teacher can apply six different methods 
falling roughly into three categories. The first three - modelling, coaching 
and scaffolding - aim at helping the pupils acquire an integrated set of 
cognitive and metacognitive skills via observation, guided and supported 
practice, and feedback. Two other methods - articulation and reflection - are 
techniques that help pupils analyse their own cognitive and metacognitive 
activities and confront them with the ideas and strategies of other learners, 
and ultimately, with a mental model of expert performance. Exploration, 
finally, intends to increase the learner's autonomy in skilled problem solving 
as well as in discovering, identifying, and defining a new probJem. 

With respect to the sequencing of learning tasks, two principles are 
mentioned: 1. progressive complexity and diversity, such that competent 
performance requires more and more of the domain-specific knowledge as well as 
a larger variety of cognitive and metacognitive skills; and 2. global before 
local skills, involving that the orientation towards the complex task as a 
whole should precede the practising of partial, lower-level tasks. 

Finally, the authors describe a series of guidelines that are important 
with a view to realizing a favorable social context for learning: l. situated 
learning involving that students should be given tasks and problems 
representing the diversity of situations to which they will have to apply their 
knowledge and skills afterwards; 2, organizing opportunities for contact with 
and observation of experts; 3. enhancing intrinsic motivation for learnin",; 4. 
fostering cooperative learning through small group problem solv^ .; 5. 
organizing classroom dialogues aiming at the identification, analysit,. '.d 
discussion of students' problem-solving strategies and processes. 

Although we developed our LOGO learning environment before taking 
cognizance of this model, the resemblance is striking. Indeed, in our 
instructional system we used most of the above mcintioned intervention 
techniques. Alrio, most of the principles concerning the sequencing of task;; and 
the social context ot learning were taken into consideration. 

We now pass unto an interesting issue relating to the construction of such 
powerful learning environments, especially when it concerns the training of 
thinking skills through computer progranuning in particular, but also through 



educational software in Renetal, The major conclusion that wo derived from the 
available research, is that tho totally open contact with a progrHmming 
language is not sufficient for the acquisition and transfer of thinking skills; 
attaining this goal requires systematic and explicit instruction. A key 
question in this respect is if, and to what extent, this training has to be 
built in the progr am minp . environme nt, and which part of it can better remain in 
the hands of the _teac_her. In other words, should we develop intelligent 
computer systems that can perform detailed analyses of pupils' skills and 
strategies, and subsequently provide adequate coaching and ■'.nstruction? Or 
should the latter activities rather be performed by the teacher, while the 
major role of the computer is to create an environment that stimulates learners 
to practise their own knowledge and thinking skills [21]? An example of a 
system that focussed on eliciting the use of general thinking skills in a 
programming environment, is the Michael system. This system, developed at the 
Department of Computer Sciences of the University of Leuven in cooperation with 
our research group, explicitly stimulates the step-by-step construction and 
refinement of programs. It also offers several opportunities to free the user 
from the syntactical aspects of programming, so that he can fully concentrate 
on the more essential problem-solving and designing activities [22]. 

Finally, it seems to us that future research and developmental work should 
not be limited to learning environments in which programming is the core 
component. Indeed, since we do not consider the cognitive effects observed in 
this study as resulting from the programming activity as such, but rather from 
the entire learning environment in which it is embedded, we have no ground for 
attributing computer programming a monopoly position in teaching thinking 
skills. Consequently, it is plausible to assume that the investment of the same 
amount of time, effort and expertise, can produce equally effective learning 
environments in more "traditional" content domains, and this would facilitate 
the integration of the teaching of thinking skills within the regular 
curriculimi. In fact; this implies a plea for approaching the teaching of 
thinking from a diversity of content areas. After all, the acquisition of 
EMPiallj_A2PlicA!l?:Ji problem-solving skills requires tliat children are taught 
to apply them in a diversity of domains anu prol)lein situations. This can only 
be realized through instructional planning across suli jec t- inattor domains 
focussing on the elaboration of a conunon strategy for thi nkinj'^-oriented 
i nst rue t ion . 
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Table 1. Overview of the activities in uhe LOGO course 
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Unit no. Activity 



I Acquaintance with the computer 

2-4 Elementsry primitives: FD/BK, RT/LT, PU/PD 

5 REPEAT command (the list to be repeated only contains elementary 

primitives) 

6- 7 Procedures 

8-9 Super procedures 

^0 REPEAT command (the list to be repeated also contains procedures) 

II Demonstration of the entire programming strategy 

12-14 Demonstration and practice of the soperate components of the 

programming strategy 
15-16 Practice of the strategy with relatively simple given drawings 
lV-19 Practice of the strategy with relatively complex given drawings 
20-22 Practice of the strategy with self chosen drawings 

First testsession for mastery tests 
23-25 Practice of the strategy with given drawing containing circles 

Remedial instruction 

Second testsession for mastery tests 



Table 2* Number of pupils in El and E2 who attained the mastery 
criterion on the tests for the three transfer 
conditions 



Transfer conditions 


Mastery tests 


Results 


(n=24) 






El 


E2 


1. LOGO knowledge 


LOGO knowledge 


21 


17 


2. Thinking skills in LOGO 


Planning 1 


19 


23 




Planning 2 


20 


19 




Executing/ testing 


20 


22 


3. Thinking skills in math 


Planning 1 




22 




Planning 2 




10 




Executing/ testing 




22 
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Table 3, 


Comparison of El vs . C and 
tests (MANOVA) 


El vs. E2 on 


the transfer 


Measures 


Thinking skills 


Results 






El vs. C 


El vs. E2 


Mazes/pll 
Mazp s / nl? 

1 M>* £j >J / |V &v 

Error/pln 


Planning 


.249 


>.500 


Error/deb 


Debugging 


.001 


.016 


R 1 nrlc / dpp 

U X W \^ C\. f \M C 

Weekd/dec 


Decompos i tion 


<.001 


.002 


Weekd/ext 
Boxes/ext 


Use of external 
representation 


<.001 


<.001 



10 stops 



□ 



















WINDOW CL-m . MOTOR CL-MW 

COVER CL-CL LIGHTS CL-LR RADIATOR 

LIGHT CL-LL LIGHT (GRATE CL-GG)x4 SQUARE 
I 

SQUARE 



WHEELS 
WHEEL CL-WW WHEEL 




WINDOW 



t:L-WM 



•)0 



COVKK 



90 



20 



V ; 

90 



10 



I'D 



PIJ 



•■-^0 <)() 



90 



30 



ci.-ci, 



sguARi:; 



CI. 1.1. 



Cl.-I.R 



90 



/90 



I'D , 



FIJ 



\>\) 



A 



90 



A. 



90 

\ ri) 



ci,- (u; 



Cl,- MW 



CI.- WW 
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Ki|',uro 1. Plan for writing a LOGO progtam lor drawiuf, a car 

5^ 



chore lo no proceduro named CL-WM at lovol 1 of CAR 



Figure 2. Screen effect after coding the procedure WINDOV? 



ERIC 



there is no procedure named MOTOR at level 1 of CAR 



Figure 3. Screen effect after coding the procedure CL-WM 



The carpet in our living room which measures 5m by 4,40m, has to 
be renewed. The price of the carpet is 350 per m^ . The craftsman 
charges 600 fr per hour and works 3 hours on the job. What will 
be the total cost for the renewal of the carpet? 



total cost-price 




price carpet 



wage workman 



surface x price/m^ hourly wage x duration work 



length X breadth 250 fr/m^ 600 fr/h 



3 h 



5 m 



4,40 m 



Figure 4. Plan for solving a multi-step word problem 



(A) Mark the drawing thdt the turtle wiU make vhen given the following inatructions 



INSTRUCTIONS 



BK 15 
RT 4 5 
FD 4 5 



DRAWING 



I' 



(b) Mark the instructions that the turtle recieved in order to make the following drawing 



DRAWING 



INSTRLTCTIONS 







RE?5>T 6 (STEP RT 90) 


RKPEAT 8 (STEP) 


REHEAT 4 (STEP RT 90) 


REPEAT 4 (ST-:?) 
















STEP: 1 

A 






J) 



(c) When the turtle executes the following program, it -^ra 's the parts of the figure in a well-defined sequence 
The na-nbers ii\ th** Irawirig indicate the sequence in which the turtle draws the pacts. 
Mark the drawing with the correct sequence. 



PROGRAM 



DRAWING 



TO AIRP'^NE 
CSNTRALPART 

WINGS 

TO CENTP.ALPAKT 
SNOUT 
CL-SB 
BODY 
CL-BT 
TAIL 



TO WINGS 
WING 

WING 

TO WING 

OUTLINE.VIHG 

CL-OM 

MOTOr 



SNOUT 



RODV 

C) 



TA T 1- OUTLI Nt.V I MOT^IR 



5 

6 



U 9 

8 k6 



71 3 



i 

O 



0 

9 





5 


- 3 


r, — 








1 


2 


1 

! 1 
















LJ 


IL 


9 






8 


- 6 



c ! 



Fij-',ure 5. Example? ot: an inLMn ilnvm the LOGO kn(>wb?diV- tei^t. about the oltMrn'iitary 
[jriiiutive^ (a), the P.IlPKAT ct^mm/uui (b). and the flow nt confroL (c) 



CHRISTMAS CARD 




STABLE 



WALL 




TREE 



STEM 




CONTOUR 



BALL BALL BALL 



CHRISTMAS CARD 




STABLE 



TREE 




WAXL 



ROOF 



STEM 



CROWN 



Balls 




BALL BALL BALL 



The best tree diagram is: 



Figure 5. Example of an item from the first planning test 



n . 




Figure 7, Drawing of a submarine for which the children had to draw a tree 
diagram in the second planning test 
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> I 



I 10 i3teps 
I i 




Q 




CASTLE 



^^^^^^OWER^ CL-TM MIDDLE CL-MT 

FRONT^L-FR ROOF GA iT'^CL^^^if^^^^BR^ CRENELS 

WALL CL-WW WINDOW DOOR CL-DD DOOR (CRENEL ^CL^C)x6 



TOWER 



;"\90 30 



40 



^90 



90 90 



6 — 

90 10 



90 



15 



^ 



10 PD 



15 



PU 



10 



^ 25 
PU 



PU 30 




60 



30 



40 



PD 



WALL 
90 

!^ 27,5 



20 



''OOR 



10 
A 



CL-W 



WINDOW 



CL-FR 



ROOF 



90 



r 



90 



^90 



PD 27,5 



^90 90 

PU ■ \ 2 7,5 \?D 
A A 



CL-DD 



55 



90 



PD 



PU 



10 



20 
PU 



CL ,:b 



CL-TM 



PD 

10 

Pi; I PI) 



35 



5 PU 



BR I DC K 



CL-BC 



CRENEL CL-CC 



CL-MT 



Fip.ure 8. Drawing of a castle, together with a faulty plan, given as starting 
point for the pxecuting-and-t'^ sting phase 



In this maze you see thi ae salads: a yellow, a green and a brovn 
one. In the middle of the maze you see a red figure. This is a 
hungry beetle. He now wants to eat the three salads I 
You can steer the beetle as follows: if you push an arrow-key, 
the beetle is set in the direction of the arrow; if you push the 
space-bar, the beatlf? moves one step forward. As soon as the 
beetle reaches the salad, it is eaten. 

Mind this I The beatle is very lazy; it wants to move as few steps 
as possible to eat the three salads. Therefore, the covered 
distance (this is the distance from the starting point up to the 
last salad) should be as short as possible. The time is of no 
importance . 




Figure 9. Example of an item from the mazes test 



Mrs, Fisher was moving nto a new apartment with the help of two 
movers. She asked them to arrange the furniture in het apartment 
and gave them a list of directions* The movers followed the 
Instructions perfectly ; however there was a bug in the 
directions; consequently the furniture was not arranged 
correctly. Picture A shows how Mrs* Fisher wanted her apartment 
to look like; picture B how the furniture was really arranged by 
the ATiovers. Try to find the bug in Mrs. Fisher's directions and 
correct it. 




These are Mrs. Fisher's directions. 

In the kitchen: 

Put the electric cooker at the left of the dresser. 
Put the automatic dishwasher at the other side of the dresser. 
Put the refrigerator at the right of the automatic dishwasher. 
Put the table in the south-eastern corner of the kitchen. 
Put the chairs around the table. 

In the living room: 

Put the sofa against the northern wall. 
Put the two seats facing the sofa. 
Put the table between the sofa and the seats. 
Put the cabinet against the southern wall. 

In the bedroom: 

Put the head of the bed against the southern wall. 

Put a pedestal on each side of the bed. 

Put the wardrobe against the wall of the kitchen. 



Figure 10. Example of an item from the error detection test 



Deficribe the complex figures by indicating which elements they 
contain. You have to use either the single elements (the blocks 
S, R, T, C) or the other complex figures. It is important that 
you use as few elements as possible; therefore you have to choose 
each time the biggest available figure. In enumerating the 
elements, you work from left to right and from bottom to top. 

Here is an example: 




S R T C 

(Square) (Rectangle) (Triangle) (Circle) 



A A A 

Q . on 

□ 0 n n I 



1 


2 


3 


Figure number 


Solution 


1 


R, 2 




2 


C, D 




3 


V, 1, V, 1, V 





Figure 11. Example of an item from the blocks test 



M 



W 




day before 
yesterday 



today tomorrow 




tomorrow 



today 



1 

S-1=F 



day before 
yesterday 

F-2=W 



Figure 12. Two examples of decomposition and external represen- 
tation of an item from the weekdays te.st 
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(b) 




S S S S S S S 



Figure 13. Two examples of external representation of an item from the 
boxes test 
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